Accepted to ApJL 

Preprint typeset using LSTgX style emulateapj v. 10/09/06 



A SEARCH FOR LYMAN BREAK GALAXIES AT z > 8 IN THE NICMOS PARALLEL IMAGING SURVEY 1 

Alaina L. Henry 2 , Matthew A. Malkan 2 , James W. Colbert 3 , Brian Siana 3 , Harry I. Teplitz 3 , Patrick McCarthy 4 , & 

Lin Yan 3 

Accepted to ApJL 



o 
o 

(N 
(N 



> 

in 

o 

o 
l> 
o 



Of 
I 1 

o 

d ■ 



X 



ABSTRACT 

We have selected 14 J-dropout Lyman Break Galaxy (LBG) candidates with J\ io— #160 > 2.5 from the NIC- 
MOS Parallel Imaging Survey. This survey consists of 135 square arcminutes of imaging in 228 independent 
sight lines, reaching average 5a sensitivities of /no = 25.8 and H\(,o = 25.6 (AB). Distinguishing these can- 
didates from dust reddened star forming galaxies at z ~ 2 - 3 is difficult, and will require longer wavelength 
observations. We consider the likelihood that any J-dropout LBGs exist in this survey, and find that if L* 95 is 
significantly brighter than L* =6 (a factor of four), then a few J-dropout LBGs are likely. A similar increase in 
luminosity has been suggested by Eyles et al. and Yan et al., but the magnitude of this increase is uncertain. 

Subject headings: galaxies: high-redshift- galaxies: evolution - galaxies: formation 



1. INTRODUCTION 

Searches for Lyman break galaxies (LBGs) have measured 
their luminosity funct i ons out to high red shifts (z = 4-5; 
Kashi kawa et al.l 120061: [Yoshida et al. 2006). This indicates 
that substantial numbers of galaxies were in place at z=6, 
and th at galaxy formation m ust be ongoing a t higher red- 
shifts. lYan et al l (120061) and lEyles et all (12006b have shown 
that the existing mass in /-dropouts at z = 6 can not be as- 
sembled unless star formation rates were higher in the past. 
The implied rapid first bursts of star formation at z > 7 could 
produce galaxies with large enough rest-wavelength UV lu- 
minosities to be detected in the near infrared. In addition, it 
is currently uncertain if the the amount of star formation at 
z = 6 is adequate to reionize the universe. J-dropout LBGs 
may play an import ant role in this pro cess, which is likely 
between 9 < z < 14 dSpergel et al.ll2006l) . 

The NICMOS Parallel Imaging Survey dHenry et al.ll2005b 
Henry et al. in prep), provides the unique combination of sen- 
sitivity and wide area coverage required to find rare, luminous 
LBGs with 8 < z < 1 1. With 135 arcminutes 2 in 228 indepen- 
dent sight lines, we cover an order of magnitude more sky than 
the NICMOS po r tions of Hubble Deep F ield North (HDF-N; 
lDickinsonlll999t iThompson et al.llT999l) and the Ultra Deep 
Field (UDF: IThompson et al.ll2005l) . Although the NICMOS 
Parallel Imaging Survey is less sensitive than these surveys, 
the galaxies presented here are better suited for follow-up ob- 
servations. In addition, it surpasses most ground based imag- 
ing. 

We have identified a sample of possible J-dropout galaxies 
from the NICMOS Parallel Survey, and here we discuss the 
likelihood that any of them are at z > 8, as well as the possible 
implications for star formation near the epoch of reionization. 

1 Based on observations made with the NASA/ESA Hubble Space 
Telescope, obtained from the Space Telescope Science Institute, which is 
operated by the Association of Universities for Research in Astronomy Inc., 
under NASA contract NAS 5-26555. These observations are associated with 
proposals 9484, 9865, and 10226. 

2 Department of Physics and Astronomy, Box 951547, UCLA, Los 
Angeles, CA 90095, USA; ahenry@astro.ucla.edu, malkan@astro.ucla.edu 

3 Spitzer Science Center, California Institute of Technology, 
220-6, Pasadena, CA, 91125, USA; colbert@ipac.caltech.edu, 
bsiana@ipac.caltech.edu, hit@ipac.caltech.edu, lyan@ipac.caltech.edu 

4 Observatories of the Carnegie Institute of Washington, Santa Barbara 
Street, Pasadena, CA 91101; pmc2@ociw.edu 



We use H = 71 km s" 1 Mpc" 1 , A = 0.73, and Vl M = 0.27, and 
AB m agnitudes are used t hroughout. We take M* s00 (z = 3) = 
-21.1 (Ste idel et aTJ.1 19991) . which corresponds to Hm = 26 .4 
atz = 9.5. 

2. OBSERVATIONS & SOURCE SELECTION 
2.1. The NICMOS Parallel Survey 

We conducted the NICMOS Parallel Survey in Hubble 
Space Telescope (HST) observing cycles 7, 11, 12, and 13. 
Images and slitless grism spectroscopy wer e obtained in the 
parall el mode, using the NICMOS 3 camera (Thomps on et all 
1998). Early results f rom the cycle 7 survey are presented in 
McCarthy et ail (fl999h . Yan et al. (1998, 1999, 2000), and 
iTeplitz et al.l(il998l) . 

The cycles 11, 12, and 13 imaging data will be described in 
more detail in Henry et al. (in prep); we provide a summary 
here. Each field was observed with both the /no (F110W) 
and //i6o (F160W) filters, with average integration times of 
~1500 s and ^2000 s . Images are drizzled according to 
iFruchter & Hookl (119971) . and the resulting point spread func- 
tion has a FWHM ~ 0.3". Photom etry was performed with 
SExa'actoiMBer tin & AjnoutsTl 996) in dual image mode. The 
//i6o images were us ed to detect sources, and fluxes were mea- 
sured from identical Kron ( 1980) apertures in both bands. We 
require 9 pixels above 1 .5cr for detection. We further require a 
5a detection in Hi6o, as measured in a 0".8 diameter aperture. 
The average 5<r sensitivities reached are Jno = 25.8 and Hi6o 
= 25.6. We detect 7700 objects; the color magnitude diagram 
is shown in Figure Q] (left). 

2.2. J-dropout candidates 

In Figure Q] (right) we show lBruzual & Charloll (12003) evo- 
lutionary tracks to which we have added an IGM foreground 
absorption component which is completely opaque beyond 
z = 6, where Lya passes into the /no filter. In addition, we 
show examples of two local ultra-luminous infrared galaxies 
(ULIRGs), Arp 220, and IRAS 03521+0028. For Arp 220 we 
compile the UV to near inf r ared s p ectral energy distri bution 
(SED) from lGoldadeTeTall (12002b . ISurace et all d2000h , and 
the RC3 catalog. For IRAS 03521+0028, which has a very 
red rest frame optic al SED, only the BIHK' photometry from 
ISurace et alJ(l2000l) is available, so we do not extend this track 
beyond z = 2. 
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Left — The NICMOS Parallels Imagi ng Survey color m agnitude diagram. All points are 5<r detections, or better, in //i6o- Arrows represent sources 



Fig. I. 

with no ]\ io detection above 3o\ We overplot the Bruzual & Chariot 12003) evolutionary track of a galaxy which formed at if = 12, with a Ay = 1, a Salpeter 
IMF, solar metallicty, and an exponentially declining star formation rate with a 500 Myr e-folding time. This model g alaxy has a stellar m ass of 7 X 10 10 M Q 
at z = 0. The track is marked with fiducial redshift points at z = 0.5, 1.0, 1.5, 2.0,2.5 (peak), 3.0, 3.5. Right -Curves show Bruzual & Chariot 1 2003) evolutionary 
tracks. All models have a Salpeter initial mass function and solar metallicity. The bluest, dot-dashed track is a 10 Myr old model with constant star formation 
and no extinction, while the remaining tracks are evolving, with z/ = 12. Their star formation histories and extinctions are: dotted- Constant with 10 Mq yr~' , 
and Ay = 0; solid- Exponentially declining, with a 0.5 Gyr e-folding time, and Ay = and 2; dashed- An instantaneous burst with Ay = 0. Extinction is added 
following the prescription by Cardelli et al. ( 1989), which contains a 2000A bump. At z, ~ 6 this feature is in the //i6o filter, the resulting dust obscured color is 
bluer than the intrinsic color. We also show the expected colors from two local ULIRG SEDs, Arp 220 (crosses), and IRAS 03521+0028 (points). The horizontal 
line indicates the color cut which we made at /no — #160 > 2.5. 



To minimize contamination from lower redshift interlopers, 
we adopt the color selection /no - -ffieo > 2.5 for J-dropout 
candidates. Figure Q] (right) shows that the reddest J-dropout 
LBGs will be selected at z > 8, while nearly all models meet 
this criterion at z > 10. We find 14 J-dropout candidates (Ta- 
ble [TJ; five are detected in /no (at 3cr or better), but this does 
not disqualify them as LBGs, since some flux will fall in the 
Ji io filter for z < 10.5. The remaining nine galaxies are among 
the sources which are plotted as lower limits (upward point- 
ing arrows) in Figure Q] Possible contamination from lower 
redshift sources is discussed in jj3.ll 

Since exposure times varied from field to field, the NIC- 
MOS Parallel Survey is inhomogeneous in sensitivity. For 
selection of red galaxies, the faint limit of the sample is de- 
termined by the sensitivity in the /no images. For example, 
at H]6o = 23.3, 98% of the /no images have sufficient sensi- 
tivity for sources to be selected with /no~#i60 > 2.5. A half 
magnitude fainter, at Hk,o = 23.8, this completeness drops to 
~ 50%. Since fainter galaxies are more likely to be genuine J- 
dropoutLBGs, we consider all galaxies with /no - #160 > 2.5, 
and correct for this incompleteness. 

3. DISCUSSION 
3.1. Foreground Contamination 

Figure Q] (right) shows that some lower r edshift galaxies 
may b e selected as J-dropout candidates. iBouwens et al.l 
(2005) find three galaxies with /no -#160 > 2.5 in a 15 
arcmin 2 survey. This density is consistent with the 14 sources 
we have found, since the NICMOS Parallel Imaging Survey 
covers ten times the area of Bouwens et al., although with 
less sensitivity. Bouwens et al. use optical and K-band pho- 
tometry to argue that these galaxies are all at lower redshift. 
Since they find no J-dropout LBGs with /; io-#i6o > 2.5, the 
implied density is less than 250 degree" 2 . 

In addition, we c onsider the SEDs of two local ULIRGs. 
iDaddi et all d2005l) have shown that ULIRGs have a sur- 
face density of about 1 arcmin -2 at z = 2-3. For Arp 220 
(Lbd = 1.5 x 1Q 12 Lq), we expect H\(,q = 23.6 at z = 2, which is 
typical of the galaxies in this survey. However, ULIRGs like 



Arp 220 are not red enough at z = 2- 3 to be selected as part of 
this sample. In Figure Q] (right) we show the predicted color 
of another ULIRG, IRAS 03521+0028, which has a very red 
rest frame optical SED. This galaxy is red enough to be se- 
lected at z = 2, but it is doubtful if many ULIRGs at z = 2- 3 
can be described by this red optical SED. If ^10% display 
similar colors, this could account for the 14 J-dropout candi- 
dates. While galaxies like Arp 220 could also be selected by 
our color cut at z ~ 4-5, ULIRGS at these redshifts are ex- 
pected to be rare, and would have to be very luminous, with 
Uoi > x 10 13 L Q . Even at z = 2-3, the density o f ULIRGs of 
this lu minosity is low, with only ^15 degree -2 dL. Yan et al.l 
120051) . 

Contamination from Galactic sources is improbable. 
Dicki nson et al.l ( 120001) report on a similar point source in the 
HDF-N, with /no— #160 > 2.3, and find that it is unlikely a 
stellar or substellar source. 

3.2. Estimating the Density of Galaxies at z > 8 

Since no objects have ever been confirmed at less than 500 
Myrs after the Big Bang, it is difficult to predict how bright or 
numerous they will be. Since small uncertainties in L* =9 5 can 
have a large effect, we consider both a Schecter luminosity 
function (LF), and a broken power law of the form: 



<j)(m) = 



(1) 



^Q0.4(ai+l)(m-m*) _|_ J Q0.4(a 2 +l)(m-m*) 

with faint end slope a>i and luminous slope a 2 1 . In Figure [2j 
we show contours in surface density, calculated by integrating 
the luminosity function for a range of plausible <f>* and H*(z = 
9.5): 

N = dz— I P(m,z)(j>(m,m*(z))dm. (2) 
J-, Jm 

This allows for the dimming of H* m with redshift, which is 
large for z > 10.5, where the Lya absorption passes into the 

1 We fit t he ab ove broken power law to the z = 3 population from 
ISteidel et al l fl999l) . and the z = 6 LBGs from IBouwens et alj (7WS) . We 
find c*2 ~ - 4, and cx\ ~ —1.6 in both populations, so we hold both slopes 
constant. 
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FIG. 2. — Contours of galaxies per square degree for this survey (solid) and a survey which is complete to 28.0 (dashed), calculated using a Schecter luminosity 
function (left), and a broken power law with the high-L slope fixed at -4 (right). The grey region indicates 1-10 objects in this 135 square arcminute survey. The 
dot-dashed curve indicates < 250 degree -2 in the Bouwens et al. (2005) search for J-dropout LBGs. In the right panel, the dot-dashed curve overlaps the solid 
contour for 1 degree -2 . The points indicate estimates of the LF at z=9.5, from lower redshift populations. 

i/i6o filter. The quantity dz^r is the comoving volume ele- 
ment, and P(m,z) corrects for galaxies which are missed be- 
cause of incompleteness, or because they are not red enough 
to be selected by our color cut. To estimate P{m,z), we sep- 
arate the quantity into P(m,z) = P\{m)pi{z), taking p\{m) as 
the completeness which we discussed in 32.21 For P2(z), we 
assume that galaxies are equally distributed between the red- 
dest and bluest models in Figure Q] (right) 2 , so that p2(z) in- 
creases from zero to one between 8 < z < 10. Under these 
assumptions, the galaxies in this survey should lie between 
8 < z < 11, with an average redshift of between z = 9 — 10, 
depending on the chosen LF. We therefore adopt an average 
redshift of z = 9.5. We repeat this calculation to estimate a 
constraint on the LF based on the upp er limit in surface den- 
sity found in the lBouwens et alj (120051) search for J-dropouts, 
which consists of six fields imaged to an average sensitiv- 
ity of H m = 28 .0. L ike the NICMOS Parallel Survey, the 
iBouwens et al.l d2005l) survey is limited by sensitivity in /no, 
so that galaxies with /no _ ^i60 > 2.5 are only selected down 
to //i6o ~ 25.5. Their finding of less than 250 degree" 2 is plot- 
ted as the dot-dashed line in Figure [2] Also, for comparison 
to more sensitive surveys, we show surface densities calcu- 
lated with pi(m) = 1 and a detection limit of Hk,q = 28 (This 
requires a sensitivity of /no = 30.5, which can be reached in 
less than 10 hours of integration with the James Webb Space 
Telescope). 

These plots show the expected density of J-dropout LBGs, 
based on a given H* and <f>* . The shaded area of Figure [2] 
shows the allowed region for H* and (f>* if 1-10 J-dropout 
LBGs exist in this survey. If none of the candidates are z > 8 
LBGs, then H* and <fi* should be below the shaded region. 
We show examples from a few observed LFs, including the 
broken power law fits which w e made. If the z = 6 measure- 
ment by lBouwens et al.1 J2006) is a good indicator of the pop- 
ulation at z ~ 9.5, then the density of sources which we ex- 



pect is of order 0.01 degree in the Schecter form, and about 



2 This is c onsistent with the results of Thompson 420031) and 
Thompson et al. (2006), which find that high redshift galaxies are best fit 
by the bluest spectral types. Even the reddest model used here is only a few 
hundred Myrs old at z = 8 and is therefore comparable to the blue models 
used by Thompson et al. 



1 degree 2 in the broken power law LF. These densities are too 
low to suggest any J-dropout LBGs in the NICMOS Parallel 
Survey, which cover s only 0.04 degree 2 . On the other hand, 
Richa rd etal.1 (12006b . in a lensing survey for J-dropout galax- 
ies, find that t he z = 8 - 1 LF may be more like the z = 3 LF by 
ISteidel et al.l (119991) . In this case, the chances of finding a J- 
dropout LBG in the NICMOS Parallel Survey are better, with 
about 1-10 degree -2 in both the Schecter and broken power 
law forms. 

The LF constraint which we estimated fro m the absence of 
J-drop out galaxies with7no-//i60 > 2.5 in the lBouwens et al.l 
(2005) survey suggests they are too few and too faint for 
any to be found in the NICMOS Parallel Survey. However, 
Bouwens et al. survey only a small volume for rare objects, 
and so th e cosmic varianc e wil l be large. Altern atively, the 
results of lYan et al.1 (120061) and lEyles etaLl (120061) show that 
to produce the observed mass density at z = 6, the progen- 
itors at z > 7 must have formed stars more rapidly in the 
past. The mag nitude of this brightening is uncertain, but 
lEyles et aTl (|2006l) suggest it is a factor of a few. We show 
this inferred LF, as two tim e s brig hter than the z = 6 mea- 
surement by IBouwens et al.l d2006l) . with no density evolu- 
tion. This predicted LF is similar to the measurement by 
iRichard et al.l (120061) . again, suggesting that we expect, at 
best, a 40% chance of finding a J-dropout LBG. If the bright- 
ening in the LF is instead a factor of four larger than at z = 6, 
then we can expect one or two J-dropout LBGs. In addition, 
we find that more than a factor of ten increase in L* (with 
no density evolution) is unlikely, since we would then expect 
more than 16 galaxies with /no - #160 > 2.5 in this survey. 

3.3. Star Formation & Reionization at z > 8 

J-dropout galaxies may play an important role in the reion- 
ization of the universe. The critical star formation rate den- 
sity (psfr) required to ionize the universe, is Psfr(z = 9.5) = 
0.09 Mq yr" 1 Mpc" 3 (iMadau et al.ll 19991) . if all ionizing pho- 
tons escape the galaxies, and the clumping factor of ionized 
hydrogen is 30. These parameters are uncer tain, but this is 
much larger than the upper limit posed by IBouwens et al.1 
d2005l) for galaxies at z ~ 10. Alternatively, for the LF 
which predicts a few J-dropout LBGs in this survey, where 
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TABLE 1 

J-DROPOUTLBG CANDIDATES WITH J\ 10 — #160 > 2.5. 



ID 


"160 


#160 S/N 


J] in-ffifin (AB) 

" 1 1U 1 OU V- 1 / 


RA (J2000) 


Dec(J2000) 


FWHM (") 


1 


24.8 


36 


> 2.7 


14 46 16.09 


40 30 10.9 


0.32 


2 


23.2 


26 


>2.6 


22 15 11.95 


-14 08 01.0 


0.55 


3 


23.9 


26 


>2.6 


02 05 29.41 


-12 05 55.1 


0.39 


4 


24.2 


35 


>2.7 


02 31 17.39 


-08 49 17.5 


0.30 


5 


23.3 


50 


3.2 


00 59 36.34 


-51 13 55.5 


0.44 


6 


23.9 


30 


>2.6 


07 44 21.68 


39 21 41.1 


0.42 


7 


23.7 


37 


>2.8 


09 48 39.80 


67 30 23.7 


0.32 


8 


24.0 


43 


>2.9 


10 47 44.77 


13 46 58.1 


0.46 


9 


23.9 


28 


2.6 


15 34 13.04 


26 48 24.3 


0.36 


to 


23.2 


48 


3.1 


12 35 42.37 


62 10 30.4 


0.38 


11 


22.7 


51 


2.7 


02 09 57.31 


-50 55 29.2 


1.47 


12 


23.7 


27 


>2.6 


21 03 57.60 


03 16 28.2 


0.37 


13 


23.8 


30 


2.6 


17 58 07.12 


66 45 19.9 


0.49 


14 


23.1 


33 


>2.8 


00 25 42.99 


-12 25 29.2 


0.39 



L*_ 9 5 = 4 x L* =6 , and <j)*_ 95 = <p* =6 , we calculate Psfr(z = 
9.5) ~ 0.1 M Q yr" 1 Mpc" 3 in both the Schecter and broken 
power law forms. In this case, J-dropout LBGs may be capa- 
ble of reionizing the universe, although the uncertainties in the 
escape fraction of ionizing photons, and the clumping factor 
of ionized hydrogen must be addressed. 

To conclude, it is not implausible that p SFR is very large 
during the first few hundred million years of galaxy forma- 
tion if stars were formed in rapid bursts. In fact, cofirmation 
of any J-dropout galaxies will suggest a large psfr for most 
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